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1. INTRODUCTION 

Constraint programming is closely related to constraint satisfaction theory, which offers a simple 
formal scheme for representing and solving combinatorial problems of artificial intelligence [1]. Among the 
tasks solved by constraint programming: checking electronic circuits, calendar planning, schedule planning, 
as well as many combinatorial tasks [2]—[4]. Constraint programming is a programming paradigm in which 
relationships between variables are specified in the form of constraints. Formally, the maximum constraint 
satisfaction problem (Max-CSP) is defined by a set of variables which are linked by a set of constraints 
following a domain of definition for each variable. Max-CSP solution is an instantiation to satisfy the 
maximum of constraints [5]. 

The concept introduction of Max-CSP leads to extensive research for choosing an appropriate 
resolution method. In addition, exact methods require very high computational time due to the size and 
complexity of the problem. Whereas approximate methods are necessary for the mission to find an 
instantiation for the maximum constraint satisfaction problem. 

The simulated annealing algorithm, in recent years, has been used to solve real problems especially 
optimization problems [6]. The peculiarity of the simulated annealing algorithm lies in its flexibility to adapt 
with any optimization problem [7]. This makes the simulated annealing algorithm more efficient, faster and 
easier to program to solve many optimization problems [8]. 

In view of the attention given to the simulated annealing approach to solve many optimization 
problems, this work adopted this approach as a method of solving Max-CSP. The simulated annealing 
method is able to avoid local minima to find the optimal solution. The optimal choice of a set of parameters 
like the cooling model, the initial temperature and the final temperature is essential to ensure good 
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convergence. The limitation of the simulated annealing method lies in the inability of the method to take into 
account the behavior of the problem during convergence. In contrast, Hopfields neural network has proven its 
ability in the field of machine learning. 

In this article, we propose a hybrid approach for solving maximum constraint satisfaction problems. 
The idea is to improve the simulated annealing algorithm in order to build a powerful system that can be 
adapted with any type of quadratic problem. To achieve this goal, we adopt the Hopfield network which is 
capable of taking the system state upon convergence to the simulated annealing algorithm to avoid the local 
solution. In order to perfect the proposed approach, three cooling models are used for the simulated annealing 
algorithm. 

This work is structured in five sections. The section 2 presents a quadratic model for the maximum 
constraint satisfaction problem. The section 3 describes the hybrid approach which combines the neural 
network and simulated annealing. The section 4 allows to implement the proposed approach to solve the 
Max-CSP. The section 5 gives a conclusion and proposes an alternative avenue of research on another field 
of application. 


2. MODELLING OF MAX-CSP 

The constraint satisfaction problem can be defined as a network of variables that are related to each 
other. In this network, the assignment of a value to a variable with the satisfaction of all the constraints 
between each pair of variables is necessary to find a solution for the constraint satisfaction problem [9]. In 
some cases, satisfaction of all constraints is impossible given the complexity and size of the problem [10]. To 
deal with this problem, reducing the number of violated constraints is necessary as a partial solution [11]. 
This paradigm is known in the literature by the maximum constraint satisfaction problem. The Max-CSP 
consists in assigning a value to a variable for the entire network with the maximum constraint satisfaction 
[12]. More formally, the maximum constraint satisfaction problem is a form of model that is represented by a 
set of variables and a set of constraints. The aim of this work is to study the binary constraints of Max-CSP. 
The maximum constraint satisfaction problem is defined by a tuple P = < X,D,C, f > such that: 
X = {x1,X2,°++, Xn}: Set of n variables 
D = {D(x,), D(x), -*+, D(x,)}: Set of domains 
C = {C,,C,,°++, Cy}: Set of m constraints 
f: objective function 

The basic idea for solving the maximum constraint satisfaction problem is based on assigning a 
value to a variable with minimization of number of violated constraints. In this context, a quadratic model 
under linear constraints is proposed. The modeling phase requires the declaration of the following 
mathematical notations: x; is a decision variable, d; is the size of decision variable x;, v,is the value 
assigned to the decision variable x;, and N is the sum of the size of all variables. 

The decision variable is defined by (1): 


1 if x; =v, 
a 1 
“ir (¢ otherwise () 


A unique value is selected for each decision variable. This expression is defined by (2): 
Yet, =1 6 wie (1,2,...,n} (2) 


A relation R;; between the variable x; and the variable x; makes it possible to define a binary constraint C;;. 
In this modelization, a matrix q of dimension N is built starting from the checking of each constraint between 
the two variables x; and x;. An element of matrix q of row i (ie. variable x;) and column j (i.e. variable x;) is 
defined: 


1i ri “s € Rij 
dwn ={ EUs ERG 6 ei ay PEE ah (3) 


0 if (y,, Vs) € Rij 
The constraint C;; is expressed: 
dj dj; 
Siz = Dre Lgnr UirjsXirXjs (4) 
The objective function is defined: 


f(x) = ep ae ean at Ggehr Nis (5) 
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The matrix form of the objective function f (x) is expressed 


f (x) = x" Qx (6) 


The Max-CSP problem is modeled as a new quadratic programming, which constitutes an objective function 
subjected to a linear constraint. 


Min f (x) = 5x" Qx 
(QP) = we a (7) 
x — 
x € {0,1} 


The matrix Q is a symmetric matrix of dimension N xX N that represents the relationship between the 
decision variables. The matrix A is of dimension N X n, which represents the linear constraint. The vector q 
is of dimension N. To solve this proposed model of Max-CSP, a new approach is proposed to solve it. 


3. THE PROPOSED MODEL SOLVED BY NEW APPROACH 

This section gives a representation of a hybrid approach that combines the simulated annealing 
method and the Hopfield neural network to solve the maximum constraint satisfaction problems. In the 
subsection of the simulated annealing approach, different cooling models are represented. Then Hopfield's 
neural network is represented as an adaptive approach to solving any quadratic problem. The last subsection 
presents a new hybrid approach that combines simulated annealing and the Hopfield neural network. First, a 
detailed description of the simulated annealing approach is shown in the next subsection. 


3.1. Simulated annealing 

The simulated annealing method mimics the physical phenomenon of crystallization [13]-[16]. 
Crystallization is an operation that allows a substance to transition from a liquid phase to a solid phase. This 
process was used in the simulated annealing method to solve an optimization problem. The operation of the 
simulated annealing method is related to a set comprises the initial temperature, final temperature and cooling 
model. Controlled cooling participates to ensure good convergence. The following notations are used for the 
simulated annealing method: x is a possible solution, E(x) is an energy function, T,, , ihe maximum 
temperature, Ti»in ihe minimum temperature, F,,qn; is a random transformation function, Fyener function 
generating a new State, and P is the transition probability defined by the following expression: 


{" AE < 0 
e Ti AE > 0 


The application of the simulated annealing method requires the use of a good cooling model to 
reduce the temperature of the energy function [17]-[19]. Controlled cooling makes it possible to switch from 
a high energy level to a low energy level. In the simulated annealing algorithm, choosing a good cooling 
model is important for better convergence. The following subsection describes the cooling models used in 
this work. 


Simulated annealing algorithm pseudocode 
Simulated-annealing (TmaxyT min Xo) 


i:=1 
To = Tmax 
Xbest = Xo 


While Ty >Tmin do 
X best: = F gener (Xi-1) 
AE: = E(Xpest) = E(x;-1) 
If P(AE,T;) > random(0,1) then 
Xi = Xbest 
Else 
Xj = Xi-1 
End if 
If E(x) < E(Xpesi) then 
Xbest = Xj 
End if 
i:=it+1 
Tis1 = Frans (Ti) 
Return Xpest 
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3.1.1. Geometric model 

The geometric cooling model is inspired by an arithmetic-geometric sequence in which each term 
makes it possible to deduce the next by multiplication by a constant factor [20]. This model is defined by the 
relation T; = aT,_; +8. The factor @ is selected from the interval [0.1]. The relation is an arithmetic 
sequence when a = 1 and is a geometric sequence when 6 = 0. Therefore, the parameter a must be different 
from 0 and 1. 


3.1.2. Logarithmic model 

The logarithmic model was first proposed by Geman and Geman by the following formula: T;,4, = 
c X (log(k + 1) )~? [21]. The logarithmic model proposes a relationship between the initial temperature and 
the final temperature. The temperature decreases in two phases: the first phase marks a rapid change in 
temperature in only a few first iterations. The second phase is characterized by a very slow change in 
temperature. Therefore, the convergence of this model is very slow and this requires considerable 
computation time. 


3.1.3. Logarithmic model 
The Lundy-Mees model is temperature cooling technique described by the following formula 
Ty41 =CX(14+6T;,)71* [22]. The parameter B is defined by the following relation: 2 = (To - Tr) x 


=1 dos ‘ 
(M. To- Tr) . The parameter Tp represents the initial temperature, the parameter T; represents the final 
temperature, and the parameter M is the number of iterations. 


3.2. Continuous hopfield network 

Physicist John Hopfield proposed the Hopfield model in 1982, it was a major breakthrough in the 
field of neural networks [23]. The Hopfield model not only allows to function as associative memory to help 
object recognition in image processing domain but also it is able to solve a lot of optimization problem such 
as the problem of installing a surveillance camera, the traveling salesman and the problems of maximum 
satisfaction of constraints [24], [25]. Due to the great use of this model, it has become the center of attraction 
for many researchers. Hopfields neural network is a fully connected network [26]. More formally, it is 
represented by a symmetrical matrix to guarantee the stability of this network. The Hopfield neural network 
is composed of n interconnected neurons [27]. The dynamics of the Hopfield neural network is described by 
the following differential (8): 

DM ee SE depp age (8) 

dt T 

The vector v = (v;,) is the input vector of neurons and u = (u;) is the output vector of neurons with 
1<i<nandu; € {0,1}. The weight matrix is given by T = (T;,;) and i? is the neuron bias. The hyperbolic 
function is used to calculate the output of each neuron. Neuron output is expressed: 


vVi= -=(4 + tanh (#)), Ug > 0 (9) 


where Ug iS a parameter used to control the gain of the activation function. Hopfield proved that the 
symmetry of the zero-diagonal matrix T is a sufficient condition for the existence of the Lyapunov function 
[28]. Therefore, the existence of the equilibrium point is guaranteed [29]. Continuous Hopfield networks are 
capable of solving combinatorial problems that have an energy function taking the following form: 


Min f(x) = 5x7 Qx 


under constraint (10) 


3.3. Proposed hybrid approach 

A hybrid algorithm consists of combining two or more different algorithms in order to arrive at an 
optimal solution. One of the objectives achieved in this work is to propose a quadratic model for the problem 
of maximum constraint satisfaction and to solve this model via a robust hybrid algorithm. This hybrid 
algorithm is a combination of two different approaches: the Hopfield neural network and the simulated 
annealing algorithm. Hopfield's neural network methodology has been widely used in optimization problems 
since their arrival. In this work, the Hopfield network was adopted to improve the convergence of the 
simulated annealing algorithm. This section presents a hybrid algorithm that can solve different problems of 
maximum constraint satisfaction. 


A new approach to solve the of maximum constraint satisfaction problem (Mohammed El Alaoui) 


920 0 ISSN: 2252-8938 


Hybrid-algorithm 

i:x1 

h=0.5 

To = Tmax 

Xpest *= Xo 

While Tg >T min do 
Xbest* = F gener (Xi-1) 
AE: = E(Xpest) — E(Xj-1) 
If E(x,) < E(x;_1) then 
X= Xj thf (x1) 


End if 
If P(AE,T;) >random(0,1) then 
Xi: = Xbest 
Else 
Xj = Xi-1 
End if 
i:=i+1 


Tis1 ia Frans (Ti) 
Return Xpest 


4. RESULTS AND DISCUSSION 

The proposed approach that combines simulated annealing and the Hopfield neural network is used 
as a solver for the maximum constraint satisfaction problem. To assess the effectiveness of the proposed 
approach, a series of instances that represent real problems is used in this work. In this section, the basic 
simulated annealing algorithm is used to solve the maximum constraint satisfaction problem. In addition, the 
proposed approach is also used to carry out the research process to ensure good convergence. 

This section presents the different instances (scens, CNF) used to evaluate the performance of the 
proposed approach. Software and hardware prerequisites are required to implement the proposed approach. 
Instances are run on a 3.0 GHs processor desktop and 4 GB RAM. The proposed algorithm is programmed 
through the use of Java object-oriented programming language. Given the stochastic nature of the proposed 
approach (the complexity of the algorithm and the structure of the test instance), the experiment was carried 
out 30 times. When implementing the proposed approach, a number of parameters can help with good 
convergence. These parameters are determined through preliminary experiment. The preliminary experiment 
made it possible to set the value of a and c at 0.99 and 3.5 respectively. 


4.1. Experiments with scens instance 

The scens instance represents that are used to compare the proposed approach with other methods. 
Figure |(a) shows the average execution time for instance scenes with a fixed number of variables that is 
equal to 100 and a number of constraints varies between 1,178 and 1,222. Figure 1(b) shows the same 
instance scens but relatively large with a number of variables ranging from 82 to 458 and with a number of 
constraints varying from 382 to 5,286. The hybrid approach that combines the Hopfield neural network and 
simulated annealing with the Lundy cooling model (HA+ Lundy) has proven to be the most robust solver in 
terms of quality and runtime. 
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Figure 1. Instance scens (a) number of variable is fixed at 100 and 
(b) number of variables beetwen 82 and 458 
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4.2. Experiments with CNF instance 

In this experiment, the conjunctive normal form (CNF) instance is used to evaluate the performance 
of the proposed approach. The first step in this experiment is to extract the data from extensible markup 
language (XML) file. The second step is to represent the relationships that lie between the variables in a 
decision function that evaluate the maximum constraint satisfaction problem. Figure 2(a) shows the average 
execution time of the CNF instance with a number of variables fixed at 40. Figure 2(b) shows the average 
execution time of the CNF instance with a number of variables fixed at 80. 
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Figure 2. CNF instance (a) number of variable is fixed at 40 and (b) number of variable is fixed at 80 


5. CONCLUSION 

Hopfield's neural network was used in this work to improve the simulated annealing algorithm. This 
makes it possible to build a new hybrid approach. Hopfield's neural network is a robust algorithm that takes 
into account the previous information to improve the direction of the algorithm towards a better solution. The 
simulated annealing is fed by Hopfield's neural network during the research process. The proposed approach 
gives better results comparing with other conventional methods. The proposed approach has made it possible 
to solve the scens instance of variable number between 82 and 458 in a better execution time. And also 
allows to solve the CNF instance of variable number is set to 40 and to 80 in a better execution time better 
compared to other approaches. Future research should attempt to model and solve the quadratic model 
associated with the query optimization problem in databases. 


REFERENCES 


[1] K. Hirayama and M. Yokoo, “Distributed partial constraint satisfaction problem,” in Lecture Notes in Computer Science 
(including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 1330, 1997, pp. 222-236, 
doi: 10.1007/BFb0017442. 

[2] V. Kumar, “Algorithms for constraint satisfaction problems: a survey,” Al Magazine, vol. 13, no. 1, pp. 32-44, 1992 

[3]  G. Dozier, J. Bowen, and A. A. Homaifar, “Solving constraint satisfaction problems using hybrid evolutionary search,” [EEE 
Transactions on Evolutionary Computation, vol. 2, no. 1, pp. 23-33, Apr. 1998, doi: 10.1109/4235.728211. 

[4] D. Steurer, “Fast SDP algorithms for constraint satisfaction problems,” in Proceedings of the Twenty-First Annual ACM-SIAM 
Symposium on Discrete Algorithms, Jan. 2010, pp. 684—697, doi: 10.1137/1.9781611973075.56. 

[5] M. C. Cooper, “High-order consistency in valued constraint satisfaction,” Constraints, vol. 10, no. 3, pp. 283-305, Jul. 2005, doi: 
10.1007/s10601-005-2240-3. 

[6] TT. Dokeroglu, E. Sevinc, T. Kucukyilmaz, and A. Cosar, “A survey on new generation metaheuristic algorithms,” Computers and 
Industrial Engineering, vol. 137, Nov. 2019, doi: 10.1016/j.cie.2019. 106040. 

[7] I. Boussaid, J. Lepagnot, and P. Siarry, “A survey on optimization metaheuristics,” Information Sciences, vol. 237, pp. 82-117, 
Jul. 2013, doi: 10.1016/j.ins.2013.02.041. 

[8] | K. Hussain, M. N. Mohd Salleh, S. Cheng, and Y. Shi, “Metaheuristic research: a comprehensive survey,” Artificial Intelligence 
Review, vol. 52, no. 4, pp. 2191-2233, Dec. 2019, doi: 10.1007/s10462-017-9605-z. 

[9] M. Charikar, K. Makarychev, and Y. Makarychev, “Near-optimal algorithms for maximum constraint satisfaction problems,” in 
Proceedings of the Annual ACM-SIAM Symposium on Discrete Algorithms, 2007, pp. 62-68. 


A new approach to solve the of maximum constraint satisfaction problem (Mohammed El Alaoui) 


922 


[10] 
(11) 


[12] 


o ISSN: 2252-8938 


M. Ettaouil and C. Loqman, “Constraint satisfaction problems solved by semidefinite relaxations,’ WSEAS Transactions on 
Computers, vol. 7, no. 7, pp. 951-961, 2008 

M. Ettaouil, C. Loqman, K. Haddouch, and Y. Hami, “Maximal constraint satisfaction problems solved by continuous hopfield 
networks,” WSEAS Transactions on Computers, vol. 12, no. 2, pp. 29-40, 2013 

J. Larrosa and P. Meseguer, “Optimization-based heuristics for maximal constraint satisfaction,” in Lecture Notes in Computer 
Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 976, 1995, 
pp. 103-120, doi: 10.1007/3-540-60299-2_7. 


[13] A. Franzin and T. Stiitzle, “Revisiting simulated annealing: a component-based analysis,” Computers and Operations Research, 
vol. 104, pp. 191-206, Apr. 2019, doi: 10.1016/j.cor.2018.12.015. 

[14] D. Abramson, M. Krishnamoorthy, and H. Dang, “Simulated annealing cooling schedules for the school timetabling problem,” 
Asia-Pacific Journal of Operational Research, vol. 16, no. 1, pp. 1-22, 1999 

[15] B. Ceranic, C. Fryer, and R. W. Baines, “An application of simulated annealing to the optimum design of reinforced concrete 
retaining structures,” Computers and Structures, vol. 79, no. 17, pp. 1569-1581, Jul. 2001, doi: 10.1016/S0045-7949(01)00037-2. 

[16] M. F. Cardoso, R. L. Salcedo, and S. F. de Azevedo, “Nonequilibrium simulated annealing: a faster approach to combinatorial 
minimization,” Industrial and Engineering Chemistry Research, vol. 33, no. 8, pp. 1908-1918, Aug. 1994, 
doi: 10.1021/ie00032a005. 

[17] A. K. Peprah, S. K. Appiah, and S. K. Amponsah, “An optimal cooling schedule using a simulated annealing based approach,” 
Applied Mathematics, vol. 8, no. 8, pp. 1195-1210, 2017, doi: 10.4236/am.2017.88090. 

[18] S. Parthasarathy and C. Rajendran, “A simulated annealing heuristic for scheduling to minimize mean weighted tardiness in a 
flowshop with sequence-dependent setup times of jobs-a case study,” Production Planning and Control, vol. 8, no. 5, 
pp. 475-483, Jan. 1997, doi: 10.1080/095372897235055. 

[19] D. Bertsimas and J. Tsitsiklis, “Simulated annealing,” Statistical Science, vol. 8, no. 1, pp. 10-15, Feb. 1993, doi: 
10.1214/ss/1177011077. 

[20] D. Henderson, S. H. Jacobson, and A. W. Johnson, “The theory and practice of simulated annealing,” in Handbook of 
Metaheuristics, Boston: Kluwer Academic Publishers, 2006, pp. 287-319, doi: 10.1007/0-306-48056-5_10. 

[21] D. Long, J. Viovy, and A. Ajdari, “My IOPscience,” Journal of Physics. Condensed Matter, vol. 8, 1996 

[22] M. Lundy and A. Mees, “Convergence of an annealing algorithm,” Mathematical Programming, vol. 34, no. 1, pp. 111-124, Jan. 
1986, doi: 10.1007/BF01582166. 

[23] J. J. Hopfield and D. W. Tank, “‘Neural’ computation of decisions in optimization problems,” Biological Cybernetics, vol. 52, 
no. 3, pp. 141-152, Jul. 1985, doi: 10.1007/BF00339943. 

[24] A. Maurer, M. Hersch, and A. G. Billard, “Extended hopfield network for sequence learning: application to gesture recognition,” 
in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in 
Bioinformatics), vol. 3696, 2005, pp. 493-498, doi: 10.1007/11550822_77. 

[25] K. Cheng, J. Lin, and C. Mao, “The application of competitive Hopfield neural network to medical image segmentation,” [EEE 
Transactions on Medical Imaging, vol. 15, no. 4, pp. 560-567, Aug. 1996, doi: 10.1109/42.511759. 

[26] M. El Alaoui, K. El Moutaouakil, and M. Ettaouil, “A multi-step method to calculate the equilibrium point of the continuous 
hopfield networks: application to the max-stable problem,” WSEAS Transactions on Systems and Control, vol. 12, pp. 418-425, 
2017 

[27] J. J. Hopfield, “Neural networks and physical systems with emergent collective computational abilities,” in Proceedings of the 
National Academy of Sciences, Apr. 1982, vol. 79, no. 8, pp. 2554—2558, doi: 10.1073/pnas.79.8.2554. 

[28] I. Goldhirsch, P.-L. Sulem, and S. A. Orszag, “Stability and Lyapunov stability of dynamical systems: a differential approach and 
a numerical method,” Physica D: Nonlinear Phenomena, vol. 27, no. 3, pp. 311-337, Aug. 1987, doi: 10.1016/0167- 
2789(87)90034-0. 

[29] P. M. Talavan and J. Yafiez, “A continuous Hopfield network equilibrium points algorithm,’ Computers and Operations 
Research, vol. 32, no. 8, pp. 2179-2196, Aug. 2005, doi: 10.1016/j.cor.2004.02.008. 

BIOGRAPHIES OF AUTHORS 


Mohammed El Alaoui © &:4 P is a Doctorate Status in applied computer sciences and 
mathematics from the Laboratory of Modeling and Scientific computing at the Faculty of 
Sciences and Technology of Fez, Morocco. He is a member of Artificial intelligence for 
engineering sciences group in the Laboratory of mathematical modeling, Operational Research 
and computer sciences. He works on Neural Network, Artificial Intelligence, classification 
problems, Database, constraint satisfaction problem and machine learning and Data warehouse. 
He can be contacted at email: md.elalaoui @ gmail.com. 


Mohamed Ettaouil © 4 P is a Doctorate Status in Operational Research and 
Optimization, FST University Sidi Mohamed Ben Abdellah USMBA, Fez. Ph.D. in Computer 
Science, University of Paris 13, Galilee Institute, Paris France. He is a professor at the Faculty of 
Science and technology of Fez FST, and he was responsible for research team in modelization 
and pattern recognition, operational research and global optimization methods. He was the 
Director of Unit Formation and Research UFR: Scientific computing and computer science, 
Engineering Sciences. He is also a responsible for research team in Artificial Neural Networks 
and Learning, modelization and engineering sciences, FST Fez. He is an expert in the fields of 
the modelization and optimization, engineering sciences. He can be contacted at email: 
mohamedettaouil @ yahoo.fr. 


Int J Artif Intell, Vol. 11, No. 3, September 2022: 916-922 


